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Abstract. Let {X„} be a Markov chain with transition probability pij — aj_(-j_j^)+ , Vi, j > 
0, where aj = provided j < 0, oq > 0, ao + ai < 1 and X^J^o ~ ^' 
jj, — '^^-inUn. It's known that is positive recurrent when ^ < 1; is null re- 

current when fi — 1; and is transient when fj, > 1. In this paper, we shall discuss the 
first returning speed and the last exit speed more precisely by means of {a„}. 
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where = for ah A; < 0. Suppose that < < 1 , ao+oi < 1 



1. This Markov chain is known as model repair shop, see ^ and [T]. The 
process X is an irreducible Markov chain. Let fi 



nan- Then X is positive recurrent 

n=l 

if /i < 1; is null recurrent if fi = 1; and is transient if > 1. 

Suppose that P{Xq = 0) = 1, t = tq = inf{n > 1 : X„ = 0} and L = Lq = sup{n > 
: Xn = 0}. When = 1, X is null recurrent. That is, P{t < oo) = 1 and E{t) = oo. 
But for what < a < 1 that can make E(t°') < oo? Similarly, when /i < 1, X is positive 
recurrent. That is, P{t < oo) = 1 and E{t) < oo. But for what 1 < a < oo that can 
make E{t") < oo? In a word, when /x < 1, the first returning time to is finite almost 
surely, but how can we describe the returning speed in more detail? When > 1, X is 
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transient, that is P{L < oo) = 1. On another words, the last exit time from is finite 
almost surely. How can we characterize the exit speed more precisely? For example, 
for what < a < oo that can make E{L°') < oo? In this paper, we shall answer these 
questions. 

This paper is organized as follows. In §2, the first returning speed and the last exit 
speed for any Markov chain are discussed. Then in the following, we focus on the repair 
shop model Markov chain. In §3, the first returning speed is discussed in the case that 
H = 1. In §4, the last exit speed is discussed in the case that > 1. The first returning 
speed in the case that /x < 1 is discussed in §5. 

Throughout this paper, let N be the set of all positive integers. For any sequence 
{w{n)}, let Aw{n) = w{n) — w{n — 1) and A.'^w{n) = Aw{n) — Aw{n — 1). Let W be the 
class of all nonnegative increasing sequence {■w(0),w{l),w{2),- ■ ■ ) such that Aw{n) is 
decreasing and lim„^oo Ati;(n) = 0. For any two nonnegative sequences {an} and {bn}, 
we use On ~ bn to denote the case that there is < ci < C2 < oo and M G N such 
that cia„ < bn < C2an for all n > M. For any nonnegative functions f{x) and g{x), 
f{x) ~ g{x) as X ^ means that there is < ci < C2 < oo and < < 1 such that 
cif{x) < g{x) < C2f{x) for all < x < xi. Use f{x) = o{g{x)) as a; ^ to denote the 
case that lima;^o ^ = 0. If lim^-^o ^ = oo, then we write /(x) = @{g{x)) as x ^ 0. 
Similarly /(x) ~ g{x) as x — )• 1 means that there is < ci < C2 < oo and < Xi < 1 
such that ci/(x) < g{x) < C2/(x) for all xi < x < 1. 



Suppose that is a Markov chain on a probability space ($7, J-", P), with n-step 

transition probabilities Pxy ■ Suppose that x is a state and P{Xq = x) = 1. Let r and L 
be the first returning time to x and the last exit time from x respectively. That is 



2. General results for Markov chains 



r = infjn > 1 : Xn 
L = sup{n > : X, 



n 



x}, 
x}. 



where inf = oo and sup = 0. For any t > 0, let 



E{e;T < oo}. 



oo 



n=0 



E{t^;L < oo). 



It is known that 



(2.1) 




Let p = F{1) = P{t <oo),q = 



1 — p. Then for any nonnegative integer n, 



P{L = n) = P{Xn = 



X, Xn+l / X, Xn+2 / X, • • • ) = qP{Xn = x). 
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Hence we have 

(2.2) L{t) = qU{t). 

The state x is said to be recurrent if p = 1, otherwise x is said to be transient. If x is 
recurrent, then P{L = oo) = 1, otherwise P{L < oo) = 1. That is, if x is transient, then 
with probabihty one wih leave from x sooner or later. Now a natural question has 

arisen: how can we describe the last exit speed from x more precisely? In 
[6], the moments of last exit times for Levy processes are studied. In [8], the weighted 
moments of last exit times for Markov processes are studied. In this section, we shall use 
F{t) and U{t) to discuss the last exit speed for Markov chains. 

On another hand, if x is recurrent, then though with probability one will return 

to X, but the first return speed may be quite different. To deal with this, recurrent states 
are divided into two classes: positive recurrent and null recurrent. The sate x is positive 
recurrent if and only if E{t) < oo. In [7], we discussed the first returning speed of null 
recurrent Markov chains. There, we proved that if x is a null recurrent sate, then for any 
w gW, 

oo ^ 

E(w(t)) < oo if and only if V -nA^w(n + 1)[F(1) - F(l )] < oo. 

n=l 

But there are many positive recurrent Markov chains, and their returning speed may be 
quite different too. So another question has arisen: how can we characterize the first 
returning speed of positive recurrent states more precisely? In this section, we 
shall also discuss this question. 

Let Rq be the decay parameter of x, that is 

Rq = sup{i > : F{t) < 1}. 

Then by equationEH Rq = sup{t > : U{t) < oo}. If F{Ro) = 1, equivalently, U{Ro) = 
oo, then we say {X^} is i2o-recurrent. If F'{Ro) < oo, that is, E{Rqt;t < oo) < oo, 
then x is said to be -Ro-positive recurrent. In this case, has some nice properties, 

see for example [3] and [1]. For discuss conveniently, we introduce another parameter 

Ri = sup{t > : F{t) < oo}. 

Obviously, Ri > Rq > I- If X is recurrent, then Rq = 1. If X is i?o-transient or i?o-null 
recurrent, then Ri = Rq. The main results of this section are the following two theorems. 
Theorem 12.11 is followed by lemma [2?2] directly. 

Theorem 2.1. Suppose that {X„} is RQ-recurrent, Ri < oo and F{Ri) < oo. Then we 
have the following properties. 

(1) For any A; G N, E{R\t^\t < oo) < oo if and only ifF^^\Ri) < oo. 

(2) If there is an integer k >0 such that F'^'^^Ri) < oo but F^''^^\Ri) = oo, then for 
any w eW, E{RIt^w{t);t < oo) < oo if and only i/ Xl^i -^^^^("- + '^)[F^''\Ri) - 
F^^\Ri-l)]<^. 
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Theorem 2.2. Suppose that {Xn} is Ro-transient. Then we have the following proper- 
ties. 

(1) That Ri = Ro, E{R^;t < oo) < 1 and E{R^) < oo. 

(2) For any /c € N, the following four conditions are equivalent to each other. 

(a) E{RQT'';T < oo) < oo. 

(b) F'-''\Ro) < oo. 

(c) C/W(i?o) < oo. 

(d) E{R^L^) < oo. 

(3) If there is an integer k>0 such that F^''\Ro) < oo but F(''+^)(i?o) = oo, then for 
any w £ W, the following four conditions are equivalent to each other. 

(i) E{RIt^w{t);t < oo) < oo. 

(ii) E{R^L^w{L)) < oo. 

oo 

(iii) Yl -nA^w{n + 1)[F^''\Ro) - F^''\Ro - i)] < oo. 



n=l 

oo 



(iv)Y: -nA^w{n + 1)[U^^\Ro) - U^^\Ro - i)] < oo. 

n=l 

Proof. We need only to show (2) and (3). 

(2) It suffices to show that for any /c e N, F^^\Rq) < oo if and only if U^^\Rq) < oo. 
The equation U{t) = 1 + U{t)F{t) implies that 

(2.3) U^^\t) = ('^')c/»(t)F('=-*)(t),VO <t<Ro. 
It follows that 

(2.4) C/(^)(i?o)(l - F{Ro)) = U{R^)F(''HRo) + ^ U^^ {Ro)F^''-'\Ro). 

Particularly, C/'(i?o)(l - F{Ro)) = U{Ro)F'{Ro). Since F{Ro) < 1 and U{Ro) < oo, 
U'{Rq) < oo if and only if F'{Rq) < oo. Suppose that k > 2 and we have showed that for 
any n < k, F(")(i?o) < oo if and only if C/(")(i?o) < oo. By equation [231 U^''\Ro) < oo 
implies that F^''\Ro) < oo. Conversely, if F^''\Ro) < oo, then F(")(i?o) < oo for all 
n < k, and hence U^"'\Rq) < oo for all n < k. Since F{Ro) < 1 and U{Ro) < oo, by 

(2.4) , J7(*^)(i? o) < oo. Thus our result holds by induction. 

(3) By (2) and by Lemma 12.2^ it suffices to show that for any integer A; > 0, 

(2.5) C/^'^) (Ro) - C/C^) {Ro - x) ~ F^''^ (Rq) - F^^') {Rq — x), asx — )• 0. 
If /c = 0, then 
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Now suppose that k > I. By equation 12.41 

U^'\Ro){1 - F{Ro)) - U'^'^HRo - x){l - F{Ro - x)) 
= [U{Ro)F^^^ {Ro) - U{Ro - {Rq - x)] 

+ Yl (^) [U^'\Ro)F^''-'\Ro) - U^'HRo - x)F('^-'\Ro - x)]. 

Since F'{Ro) < oo, F{Ro) - F{Ro - x) ~ x as x ^ 0. Since F^'^+'^^Rq) = oo, 
_ hence x = o (C/(*^)(i?o) - U^^^Ro - x)) as X ^ 0. In addition 

C/('=)(i?o) < oo. Thus 

i7(^')(i?o)(l - F{Ro)) - U^^\Ro - x)(l - F(i?o - x)) 
= [U'^'^Ro) - U'^'^Ro - x)][l - F{Ro)] + C/W(i?o - x)[F{Ro - x) - F(i?o)] 

— x), as X — )• 0. 

Similarly, as x — )• 0, 

U{Ro)F^'\Ro) - U{Ro - x)FW(i?o - x) ~ F^'^^Ro) - F^^^Ro - x), 

(^) [U^'\Ro)F^''-'HRo) - U^'\Ro - x)F('=-*)(i?o - x)] ~ X. 

The fact that F^''+^\Ro) = oo yields that x = o{F'-''\Ro) - F'-''\Ro - x)) as x ^ 0. 
Therefore 

(2.6) C/^'^) (i?o) - U^''^ {Ro - x) ~ F^'^) (i?o) - F^''^ {Rq — x), as X — >• 0. 

□ 

Now we shall give two lemmas that are used in the proof of the theorems above. 
Suppose that {oq, ai, 02, • • • } is a nonnegative sequence. For any positive integer A^, let 

bm^ = Z]i=m7V^~"^ '^n and An = I]^=o^"- ^(*) = ^^=0^"*"'* ^ 0- Let h{n) be an 
increasing positive sequence such that 

< liminf/i(n)" < limsup/i(n)" < 1. 

n-5-oo n-s>oo 

The idea of Lemma 12.11 comes from Theorem 1 of [2] . 

Lemma 2.1. // there is Nq and x > such that for all N > Nq, 

Then An ~ A{h{n)). 

Proof. Obviously, < h{n) < 1 for all n. So we need only to consider the case that 

00 

n=0 ' 



I]r=o On = 00. For any N, 



N N 



A{h{N)) = ^a„/i(iVr>^a„/i(iVr >/i(iV)^j;a„ 

n=0 

ANh{Ny 



n=0 n=0 n=0 
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On another hand, for any N > Nq, 

oo oo (m+l)Af-l 

A{h{N)) = j2'^nKNr = j2 E ^nHNr 

n=0 m=0 n=mN 

oo (m+l)7V-l oo N 

m=0 n=mN m=0 n=0 

xAj\[ 



1 - h{N) 



N • 



Hence A„ ~ A{h{n)). □ 

By Lemma [2. 11 if c is a positive constant and {un} is a nonnegative decreasing sequence, 
then 

oo 

Now suppose that ^ a„ < oo. Then for any positive integer k and < t < 1, 



n=0 



(t) = ^ n(n - 1) • • • (n - A; + l)ant"-^ 

n=k 



Let 



oo 

A^''\l) = \imA^''\t) = ann{n - I) ■ ■ ■ {n - k + I). 

n=k 

oo oo 

Then ^ anU^ < oo if and only if ^(^^(l) < oo. Suppose that ^ an'nf' < oo and 

n=0 n=0 
oo oo 

^ Qn'Ti''^^ = OO. Let w E W. Now we show consider the finiteness of ^ an'n^w{n). 

n=0 ra=0 

oo 

Lemma 2.2. Suppose that c is a positive constant. Then a'n'n^w{n) < oo if and only 

n=0 

oo 

if £ -nA2it;(n + 1)[A(^)(1) - - ^)] < oo. 



r),=l 



Proof. We may assume that w{0) = w.l.o.g. Let bm = Y^'^=m (^nn ■ Then bm < bo < oo 
and 



oo n oo oo 

k 



n=0 n=l m=l m=l n=m 

oo oo oo 

= Y^ Aw{m)bm = Y^ [Aw(n) — A7i;(n + 1) 

m=l m=l n=m 

oo n 

= ^[Aw(n) - Aw(n + 1)] ^ 6„ 



n=l m=l 
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Since bm is decreasing, by LemmaETIl Ylm=i ~ where B{t) = bnt"-~^. 

On another hand, 



Immediately, 



= J2 ann{n-l)---{n-k + l){l+t + ---e-''-^) 

n=k+l 

oo oo 

= ^ f ^ a„n(n - 1) • • • (n - /c + 1) 

j=0 n=«+fc+l 

1=0 ^ ^ 

oo OO OO OO 



B{1) = 6„ = ^ ^ a„n^ = a„n^+i = oo. 

m=l m=l n=m n=l 

Hence -^'"'(ij-^^'^'W _ ^(i)^ as t ^ 1. Therefore Em=i bm ~ n[A('=)(l) - - ^)] 

which yields our result. □ 
oo 

By Lemma \2.2\ if there is i? > and nonnegative integer k such that ^ anR""n^ < oo 

n=0 

oo oo 

and ^ anR^n^^^ = oo, then for any w G W, X] CLnR^n^'w{n) < oo if and only if 

n=0 n=0 

oo 

E -nA2ti;(n + - ^^(i? - i)] < oo. 

3. The first returning speed for null recurrent repair shop model 

In the following, suppose that X = {X„ : n = 0, 1,2,---} is a repair shop model 
Markov chain. That is, X is a Markov chain with state space {0, 1, • • • }, transition proba- 

oo 

bility pij = aj_(j_i)+, where = for all A; < 0, < oq < 1 , ao + ai < 1 and ^ = 1. 

n=0 

oo 

Let ^Ji = nan- Suppose that P{Xq = 0) = 1 and r = inf{n > 1 : X„ = 0}. For any 

n=l 

oo 

t > 0, let G{t) = Yl ant"" and F{t) = E{t'^]T < oo). Then by [5], for any t > 0, 

n=0 

(3.1) F{t) = tG{F{t)). 

In this section we shall consider the case that /x = 1, that is, X is null recurrent. 

Firstly, we shall characterize the asymptotic behavior of 1 — F{t) as t — t- 1 by means of 
G{t). Let H be the collection of all nonnegative strictly increasing continuous functions 
on [0,1]. For any f £ Ti, the inverse function of / exists, namely /~^, defined on 
[/(O), /(I)]. For convenience, we may extend the domain of to [/(O), oo) by defining 
f~^{x) = 1 for all X > /(I). Then is strictly increasing on [/(O), /(I)], and increasing 
on [/(0),oo). 

For any h G [0, 1], let 

rh 

0(/i) = 1 - G'{1 - h),il){h) = / (Pix) dx = G{1 - /i) - (1 - h). 

Jo 
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Since (j){h) > for all < /i < 1, V'(^) is a strictly increasing continuous function on 
[0, 1], that is eH. Since ■0(0) =0 and 1^(1) = oq, i>~'^ is strictly increasing on [0, oq], 
increasing on [0, oo), V'~^(0) = and 'tp~^{x) = 1 for all x > uq. 

Let H' be the collection of all / G H that satisfying the following two properties: 

(cl) For all x,y>Q with x + y < 1, f{x + y) > f{x) + f{y). 

(c2) For any positive integer n and x G [0, f{nx) < v? f{x). 

For example, f{x) = is in T-L' if and only if 1 < a < 2. We have the following 
lemmas. 

Lemma 3.1. (l)That^ en'. 

(2) For any f G T-L' ,f~^ is a sub-additive function on [0, oo), that is for any x,y > 0, 

f-\x + y)<f-\x) + f-\y). 

(3) For any f eH' , any positive integer n and any < y < f{^), 

f-\v?y) > nf-\y). 

Proof. (1) For any h G (0, 1), 4>'{h) = G"(l - /i) > 0, so ^ is strictly increasing on [0, 1]. 
Thus for any hi,h2>0 with hi + h2 < 1, 

rhi phi+h2 



ijj{hi + /12) = / (j){x)dx + / (l>{x)dx 

Jo Jhi 



I hi 

j-hi i'h2 

> / (p(x)dx+ / (p{x)dx = ip{hi) + ip{h2). 
Jo Jo 

Similarly, since <l,"{h) = -G(3)(1 - /i) < on (0, 1), (l)'{h) is decreasing on [0, 1] and hence 
(f){h) is a sub-additive function on [0, 1]. Thus for any x G [0, ^], 

rx rx 

ipinx) = / n(f){nh)dh < (f>{h)dh = n'^ijj^x). 

Jo Jo 

Consequently, ijj £ Ti' . 

(2) Suppose that / G Ti' . Then /(O + 0) > /(O) + /(O) implies that /(O) = 0. Hence 
the domain of f~^ is [0, 00), /^^(O) = 0, f~^{x) = 1 for all x > /(I). For any x,y > 0, 
if f-^x) + f-\y) > 1, then + y)< f-\x) + f-\y) holds. 

If f-\x) + f-\y) < 1, then f[f-\x) + f-\y)] > f[f-\x)] + f[f-\y)] =x + y.li 
follows that f-^{x) + /-i(y) > /-^(x + y). 
Therefore (2)holds. 

(3) Let X = f~^{y). Then < x < ^ and f{nx) < n^f{x) = n^y. Hence f~^{n?y) > 
nf~^{y) holds. □ 

Lemma 3.2. For anyO<t<l,l- F{t) = y,-i( (i-y(*) ). 

Proof. For any < t < 1, by equation (3.1), 

^{1 - F{t)) = G{F{t)) - F{t) = ^-Ll^ 
which implies that 1 - F{t) = 0-i( (^-yW ). □ 
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Theorem 3.1. As t ^ 1,1 - F{t) ~ - 

Proof. Since limt_5.i —j-^ = 1, there is < to < li such that for any to < t < 1, 

1 F(t) 

2 - t - 

Thus for any to < * < 1; 

- 1)] < - 1)] < ^-^2(1 - 1)]. 

By Lemma l3. II and Lemma 13.21 for any to < t < 1, 

^V'-'(l-t)<l-i^(t)< 2^-1(1 -t). 

Consequently, as t — ;> 1,1 — F{t) ~ ip'-^il — t). □ 
Particularly, 1 — F{1 — ~ i^~^{n)- Theorem 12. H we have the following corollary. 

oo 

Corollary 3.1. (l)For any w G W, E[w{t)\ < oo if and only if ^ —nA'^w{n + 

n=l 

l)V'-i(^)<oo. 

oo 

(2) For any < a < 1, E{t^) < oo if and only if ^ n^'^^il)^^^-) < oo. 

n=l " 

Corollary 13.11 tells us that the returning speed of can be characterized by ip. The 
quicker that tlj~^{x) converges to as x tends to 0, the quicker that returns to 0. 

Since is dependent on G{x) completely, we can judge the finiteness of E[w{t)] by 
means of G{x) directly. Next, we shall discuss the returning speed in more detail. 

Lemma 3.3. Suppose that ipi,ip2 G CL^d n is a positive integer. 

(1) If ipi{x) < ml)2{x) as X ^ 0, then ilj2^{y) < nijj^^{y) as y ^ 0. 

(2) If iIji{x) > n^ilj2{x) as X — 0, then ^2^{y) > ml^^^{y) as y 0. 

Proof. (1) There is < xo < 1 such that ^i(x) < mp2{x) for all < x < xo. Let 
2/0 = '^i{xo)- Then yo > -01(0) = 0. For any < y < yo, < ip^^^y) < xq, and hence 

That is, y < ntfj2{'^i^{y))- Consequently, 

^2\y) < ^2'[nMi^iHy))] < nij^HM^lHy))] = n^^\y). 

(2) There is < xq < ;^ such that ^1(2^) > n'^ip2{x) for ah < x < xq. Thus by 
Lemma ISTTl for any < x < Xo, 

V'^^[V'i(x)] > V'^"^[n^V2(a:;)] > "'V'2'^[V'2(a^)] = nx. 

Letting y = i/jiix), we get that ^^""^(y) > mlj^^{y) holds for all < y < ^Iji{xq). □ 
By Lemma 13.31 and Theorem \3.1\ we immediately get the following proposition. 
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Proposition 3.1. Suppose that ipi G T-L' . 

(1) Ifasx-^ 0, V(x) = o(V'i(x)), then ast^l, 1- F{t) = e(^f^(l - t)) 

(2) Ifasx-^ 0, V(x) = e(V'i(x)), then as t 1, 1 - F{t) = o(^f ^(1 - t)). 

(3) If as x^ 0, ^i{x) ~ then as t ^ I, 1 - F{t) ~ ^r^l - 

Corollary 3.2. (l)IfG"{l) < oo, then ast^l, 1 - ~ ^T^, and £;(r") < oo i/ 
and only if a < ^. 

(2) IfG"{l) = oo, then ast-^1, l-F{t) = o(vT^), and E{t°') < oo for all a < \. 

(3) If there is < /? < 1 such that 1 — G' {x) ~ (1 — x)^ as x ^ I, then as t ^ 1, 
1 - F{t) ~ (1 - and E{t°') < oo if and only if a < 

Proof.(I) Since lim^^ti = G"{1) < oo, as /i ^ 0, (p{h) = 1 - -h)^h. Thus 

as X — )■ 0, 

^(x) = / (j){h)dh ~ / /id/i ~ x^. 



It is easy to verify that the function ^i(x) := is in H' . By Proposition 13.11 as t — )• 1, 
1 - F{t) ~ Vr^(l - = \/r^- By Theorem EH S(t") < oo if and only if a < i. 

(2) Since G"(l) = oo, as /i ^ 0, 0(/i) = 1 - G'(l - /i) = G(/i). It imphes that as x ^ 0, 

V'(x) = / (t){h)dh = Q{x^). 
Jo 

By Proposition 13.11 and Theorem 12. 11 our result holds. 

(3) Ash-^0, 4>{h) = 1 - G'(l - /i) ~ h^. Thus as x ^ 0, 

^p{x) = / (P{h)dh ~ / h^dh ~ xi+^. 



It is easy to verify that the function 'ip2{x) = x^"*"^ is in Ti'. By Proposition 13. 11 as t — )• 1, 
1-F{t) ~ V'2"^(l-*) = (1-i)^- By TheoremEU £;(r") < oo if and only if a < j^. 

□ 

Proposition 13.11 and Corollary 13.21 tell us that the quicker that G(x) tends to 1 as x 
tends to 1, the more slowly that {Xn} returns to 0. In the case that G"{1) < oo, {X„} 
returns to the most slowly. In this case E[t'^) < oo if and only if a < ^. 

Example 3.1. Suppose that a„ = i^^,n > 0. Then fJ, = 1 and {Xn} is null recurrent. 
It is easy to check that G{t) = Thus F{t) = tG{F{t)) = 2-F{t) ' '^^i^h implies that 
F{t) = 1 - ^r^. Particularly, 1 - F(l - i) = Therefore S(r" < oo) if and only 
if a < i. 

We may deduce this result by Corollary 13.21 directly. In fact G'{t) = ^^'^ 
G"{t) = Hence G"(l) = 2 < oo. So by Corollary EH 1 - F{t) ~ ^/T^, and 

E{t") < oo if and and only if a < ^. 

Example 3.2. Suppose that oq = I, ai = 0, 02 = 4, and for n > 3, 
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3 



OO 



Then G{x) = ^ a^x^ = x + |(1 - x)2 and G'{x) = 1 - ^T^. Thus E On = G(l) = 1 

i=0 n=0 

and n = G'{1) = 1. So {Xn} is a nuU recurrent Markov chain. By F{t) = t{G{F{t)), we 
get = 1(1 - ^(*))^ which imphes that 1 - F{t) ~ (1 - So £:(r") < oo if 

and only if a < |. 



We may also deduce this result by Corollarv 13.21 directlv. In fact, since 1 — G'{x) ~ 
(1 - x)^ as X 1, by Corollary [321 1 - F{t) ~ (1 - t)^ as t ^ 1. 

4. The last exit speed for transient repair shop model 

In this section, suppose that fi > 1. Then {Xn} is transient. We shall discuss the 
last exit speed from 0. Let L = sup{n > : Xn = 0}, Rq be the decay parameter of 
{Xn}. UF{Ro) = 1, then F{Ro) = RoG{F(Ro)) implies that Rq = 1. It contradicts that 
F{1) < 1. So F{Ro) < 1 and X is i?o-transient. In addition, F(t) = oo provided t > Rq. 
For any x > with G'{x) < oo, let 

e(x) = G(x) - xG'(x). 

Then ^(0) = > 0, limiti ^(1) = 1 - /i < 0, and i'{x) = -xG"{x) < for all x > 0. So 
there exits unique < xq < 1 such that ^(xq) = 0, that is, G(xo) = xoG'(xo). 

Theorem 4.1. (1) That Rq = > 1, F{Rq) = xq < 1 and E{R^) < oo. 

(2) That E{RJ)T,T < oo) = E{R^L) = oo. 

(3) For any w G W, E{Rqw{t);t < oo) < oo if and only if E{R^w{L)) < oo, and if 
and only ifY.'^=i -"-'^^'»^("' + I)V'xoH^) < c»; where tp^^ = "^^gCxcO^^^ - {1 - h) £ V.' and 

is the inverse function of ipxo ■ 

Proof. (1) At first, we shall introduce a transformation. Suppose that x > and 
G{x) < oo. Define P^''^\Xq = 0) := 1. For any n > 1 and any nonnegative integers 
io = 0, ii, • • • , i„, define 

p(")(Xo = 0,Xi = ii,--- ,X„ = i„): = — — P(Xo = 0,Xi =zi,--- 

Let Fn = '^{Xq, Xi, • • • , Xn} and F = a{Xo,Xi, ' "}■ It is easy to verify that P^^^ is a 
pre-probability measure on 

U„-Pn. Therefore p(^) has a unique extension to F which is 
denoted stih by p(^). Then p(^) is a probability measure on F. Under p(^), IS a 

homogenous Markov chain with transition probability 

G{x) 

Let 
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Then Er=o = Er=o 10) = h ^ > 0, a^^^ + ^ = 1 - ^^=2 «f ^ < 1- Thus under 
P^^\ {Xn} is a repair shop model with {Oj^"*}- 

Next we shall calculate the value F{t). For any t > 0, let 



(4.2) = Yafh^ 



G{xt) 



^ " G(x) ' 



j=0 

oo 

(4.3) F(^)(t) : = ^(^)(r;r<oo) = ^p(^)(r = n)t". 



n=l 



For any n > 1 and any nonnegative integers = 0, ii 7^ 0, 12 7^ 0, • • • , in-\ 7^ 0, 

^n— 1 

p(")(Xo = 0,Xi = ii, • • • ,X„ = i„) = ^^P(Xo = 0,Xi = ii, • • • = i„). 
It follows that 

rJn.—\ 

(4.4) p(-)(^ = ^) = __P(^ = „),Vn 



which implies that 



F(. 



Particularly, P(g^) = xF(^)(1) < 



Let /u(^) = £ jaj-'^^ Then 



(^) 

xG'(x) 



(4.5) ^ 



G(x) 



If /i(^) < 1, then {Xn\ is recurrent under p(^), that is, F(^)(1) = 1. Thus if ^gjg^ < 1, 
then P(g^) = X. For any x > with G{x) < 00, let 

ry(x) 



G(x)- 

Then ri'{x) = ^l^p- for all x satisfying G'{x) < 00. Thus r/'(x) > on (0,xo), and 
rj'{x) < when x > xq. It leads to that r/(x) is strictly increasing on [0, xq), and then 
strictly decreasing when x > xq. The maximum of rj{x) is rj{xQ). For any y > with 
F{y) < 00, y = Glny)) = ^i^iy)) ^ [0,r]{xo)]. That is, F{y) < 00 if and only if 
y < G{xo) • Tor any y G [0, 7/(2:0)], there is unique x G [0, xq] such that y = 7]{x). Since 
r/'(x) > 0, ^^^^^^ < 1 and F{y) = x, that is F{y) is the minimum solution of ri{x) = y. 

By the discussion above, we get that Rq = r/(xo) = and F{Rq) = xq < 1. Since 

/ 1, Po = riixo) > ??(1) = 1- By Theorem[221 ^(-Rq ) < o^- 

(2) By equation /i^^o) = = 1. It follows that {Xn} is null recurrent 

under That is, p(^'o)(r < 00) = 1 and ^(^o)(r) = 00. By Corollary EH for 

any w G W, £'*^^°)(t(;(r)) < 00 if and only if Yl'^=i —nls?w{n + < 00, where 

i;,,{h) = G(-o)(l - /i) - (1 - /i). By equation [121 i^^,{h) = - (1 - h). By 
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equation Sa E^-^'^t) = ''^^^Y^<^) and = fi(i^>(r);r<oo) ^ eW. 

Combination with Theorem 12.21 (2) and (3) hold. □ 

Example 4.1. Suppose that a„ = q^p,n > 0, where < p < ^ and q = 1 — p. Then 
G(t) = and = ^ > 1. So {Xn} is transient. By equation F{t) = tG{F{t)), we get 
that F{t) = WTEW. Thus Rq = F{Ro) = ^ < 1 and hence {X„} is i?o-transient. 
Further F'{Ro) = oo and F{Ro) - F{Ro - ^) = j^^J^- Hence by Theorem EZl for 
any a > 0, E{RqL°') < oo if and only if a < |. 

We may use Theorem 14.11 to deduce the results above. Clearly, G'{t) = -p^^p-. Thus 
the equation G{x) = xG'{x) has unique solution xq = Hence Rq = q^^o) ~ 4pg' 
addition Un"^ = = 2^^''^ — ^- That is under p(^o), {Xn} is the same process as 

in Example 13.11 Therefore for any a > 0, E{RqL°') < 00 if and only if a < ^. 

5. The first returning speed for positive recurrent repair shop model 

In this section, suppose that < 1. Then {Xn} is positive recurrent. We shall discuss 
the returning time of 0. Let 

Ri = sup{t : F{t) < 00}, 

R = sup{t : G{t) < 00}. 

Let D = {x > : G{x) < 00} and D' = {x > : G'{x) < 00}. If = 00, then 
D = D' = [0,00). If i? < 00 and G'{R) < 00, then G{R) < 00 and D = D' = [0,i?]. If 
R < 00, G{R) < 00 but G'{R) = 00, then D = [0,R] and D' = [0,R). If R < 00 and 
GiR) = 00, then D = D' = [0, R). 

Theorem 5.1. (1) IfG'{R) < 00 and GiR) > RG'{R), then Ri = ^ andF{Ri) = R. 

(2) If G'{R) = CO or G{R) < RG'{R), then there is unique xq > 1 such that G{xq) = 
xqG{xq). In this case Ri = > 1 o-iT'd F{Ri) = xq > 1. 

(3) That Ri = 1 if and only if R = 1. 

Proof. For any x £ D, let 
For any x £ D' , let 

C{x) = G{x) - xG'ix). 

Then r]'{x) = for aU x G D'. Since ^(0) = oq > and = -xG"{x) < 0, 

^(x) = has at most one solution. If ^(x) = has no solution, then ^ > on D' and rj 
is an increasing function on D. If ^(x) =0 has a unique solution namely xq, then ^ > 
on [0, xo) and ^ < on (xq, 00) n D' , which follows that 77 is strictly increasing on [0, xq] 
and then strictly decreasing when x > xq. By the proof of Theorem 14. H F{y) < 00 if 
and only if y = r/(x) for some x with G{x) < 00, and in this case, 

F{y) = {x : r/(x) = y, G{x) > xG'(x)} = {x : rj{x) = y, rj'{x) > 0} = min{x : r/(x) = y}. 
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If S,{x) = has a unique solution xq, then the range of 7/(x) is [0,r7(xo)]. So F{t) < oo 
if and only if t < rj{xo). That is Ri = Also F{Ri) = xq. Since ^(1) = 1 - > 0, 

Xo > 1 and Ri = rj{xQ) > rj{l) = 1. 

If ^(x) =0 has no solutions, then the range of r]{x) is [0,r]{R)] if G{R) < oo, or 
[0,r/(i?)) if G{R) = oo. We shall show that G'{R) < 1. If i? = 1, then = /i < 1 

holds. Now suppose that i? > 1. Note that ^(x) > for all x < i? and ri{x) is strictly 
increasing on [0, i?]. For any < x < R, 

G'{x) < ^ = ^ < ^ 

X r?(x) ??(^^) 

Thus 

= limG'(x) < < ^ = 1. 

Therefore < 1 and G{R) < oo. Consequently, Ri = ri{R) = ^ and F{Ri) = R. 

If ii = 1, then Ri = r/(l) = 1. If i? > 1, then Ri = r]{R) > r/(l) = 1. □ 

Similar as the proof of the statements (2) and (3) in Theorem 14.11 we may prove the 
following theorem. 

Theorem 5.2. Suppose that there is unique xq > 1 such that G{xq) = xqG'{xq). Then 
E{R\t) = oo, and for any w G W, E{R\w{t)) < oo if and only if Yl'^=i —nA'^w{n + 
l)ipxoi^) < oo, where ipxo = '^^^g(x^)^^^ — {1 — h) ^ %' and is the inverse function 
ofi'xo- 

We shall discuss the first returning speed of {Xn} further in the case that G(x) = 
xG'(x) has no positive solutions. 

Lemma 5.1. For any integer n > 2, E(t'"') < oo if and only if G^"^(l) < oo. 
Proof. By F{t) = tG{F{t)), we get that 

(5.1) F'it) = G{F{t))+tG'iFit))F'it), 

(5.2) F"{t) = 2G'{F{t))F'{t) + tG"{F{t))[F'{t)f + tG'[F{t)]F"{t). 
We shall use induction to show that 

(5.3) F(")(t) = Hn-i{t) + tG(")[F(t)][F'(t)]" + tG'[F(t)]F(")(t),Vn > 2, 

where Hn-i{t) is a polynomial function of F'(t), (t), G'(F(t)), (F(t)) 
with positive coefficients. 

By equation 15.21 equation 15.31 holds for n = 2. Suppose that equation 15.31 holds for 
some n = k > 2, that is 

F('=)(t) = Hk-i{t) + tG'^''^[F{t)][F'{t)f + tG'[F{t)]F^''\t). 

Then 

^{fc+i)(^) = Hk{t) + tG^''+^'^[F{t)][F'{t)]''+^ + tG'[F{t)]F^''+^\t), 
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where 

Hkit) = H'j,_^{t) + + ktG^'^\F{t)][F'{t)f-^F"{t) 

+G' [F(t)]F(^') (t) + tG" [F{t)]F' {t)F^^'^ {t) . 

Obviously, Hk{t) is a polynomial function of F' {t), ...,F^^\t),G' {F{t)), ...,G^^\F{t)) 
with positive coefficients. Thus equation 15.31 holds. 
It follows that 

(5.4) ^'^- ""-"^t"^^^'^ ^-^'- 



Particularly, by equation 15.11 and 15.41 
(5.5) F'{1) ^ 



(5.6) fW(1) = ^ ' ^iiiz/iL,Vn>2. 

1 - ^ 

Obviously, F"{1) < oo if and only if G"{1) < oo. Suppose that when n < k, F(")(1) < oo 
if and only if G(")(1) < oo. 

If F('^'+i)(1) < oo, then F(")(1) < oo for ah n < k, and hence G(")(1) < oo for 
all n < k, which yields that Hj^{l) < oo. Consequently G^^^'^\l) < oo. Similarly, if 
< oo, then F^''+^\l) < oo. 

Therefore by induction, for all n > 2, F('^)(1) < oo if and only if G^"'\l) < oo. Now 
the fact that E{t^) < oo if and only if F^"'\l) < oo yields our result. □ 

Lemma 5.2. Suppose that there zs A; G N such that E[t^) < oo but E{t^'^^) = oo. Then 
for any w G W, E{t^w{t)) < oo if and only ifY^^=i n^w{n)an < oo. 

Proof. By Lemma [5T| G^''\l) < oo but G^''^^\l) = oo. By Theorem [2711 for any 
w£W, E{t^w{t)) < oo if and only if Y.n=i -n/:^^w{n + 1)[F(^)(1) - F^^\l - i)] < oo. 
By Lemma [221 for any w G W, Yl^=i 'n^w{n)an < oo if and only if Yl^=i —nA'^w{n + 
l)[GW(l)-G('=)(l-i)] <oo. 
Thus it suffices to show that 

(5.7) fW(1) - fW(1 - t) ~ G('=)(1) - G('=)(1 - t), as t — )• 0. 
Firstly, we shall show that 

(5.8) G^''\l) - G('=)[F(1 - t)] ~ G^''\l) - gW(1 - t), ast — )• 0. 

For < t < 1, F{l-t) < 1-t and hence G(^)(1) - G^'^) [F(l - 1)] > G(^')(1) - G('='(1 - t). 
Since the function G^'^^x) is convex, 

G(*^)(1) - G('=)[F(1 - t)] < [1 - F(1 - t)] ['^^^^^^^ < f'(i)[g(^)(i) - g(*^)(i 

Consequently, 15.81 holds. 
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If = 1, then 

F'(^ \ - F'h -f)= l-{l-t)G'[Fil-t)]-{l-f,)G[F{l-t)] 
Obviously, 

l_(l_t)G'[F(l-t)]-(l-^)G[F(l-t)] 
= (1 - - G[F{1 - t)]} + {^,- G'[F{1 - t)]} + tG'rn - t)]. 

Note that G'{1) < oo and F'{1) < oo, combination with 15.81 we get that as t — t- 0, 

~ t, 

fi-G'[F{l-t)] ~ G'{l)-G'{l-t) 
tG'[F{l-t)] ~ t, 

and 

The fact that G"(l) = oo imphes that t = o(G'(l) - - t)) as t ^ 0. Therefore as 
t 0, - F'(l - t) ~ G'(l) - G'{1 - t). 

If A; > 2, then by equation 15.31 



_t) ^ Hk-i{l) - Hk-i{l - t) 



+ 



+ 



l-{l-t)G'[F{l-t)] 

- (1 - t)G'[F{l - + gW(1)(^)^] 

(l-/.){l-(l-t)G'[F(l-t)]} 
G'('^Hi)(tt^)'' - (1 - t)G^^\F{l - t)][F'{l - t)f 



l-{l-t)G'[F{l-t)] 
ByESland by the fact that t ~ o(G('=)(1) - G^^\l - t)) as t ^ 0, we get 

_ (1 _ - t)]\F'{l - t)f 

I- 11 

= (1 - t){-^^f{G^''\l) - G('=)[F(1 - t)]} + (1 - t)G('=)[F(l - t)]{{j^f - [F\l 

+tG^^){l){-^f 
1 - II 

as t — )• 0. 

In addition, as i — )• 0, 

_ (1 _ t)G'[F(l - tmHk-i{l) + d'\l){-^f] ~ t, 

1 - II 

1 - (1 -t)G'[F(l - t)] ~ 1 - 

Therefore 

ast — )• 0, 

and our result holds. □ 
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Theorem 5.3. IfG'{R) < oo andG{R) > RG'{R), then we have the following properties. 

(1) That E{RIt) < oo , 

(2) For any a > 1, E{R\t"') < oo if and only if Yl'^=i R^n°^o-n < oo- 

(3) If there is k £ N such that E{R\t^) < oo but E{R\t^^'^) = oo, then for any 
w eW, E{RIt^w{t)) <oo if and only if X^^^ R^n''w{n)an < oo. 

Proof. Since fi^^^ — g{R)^ ^ ^' i^"} still positive recurrent under P^^\ Hence 
E^^\t) < oo. By Lemma 15.11 for any integer k > 2, E^^\t^) < oo if and only if 
Yl'^=i o-n^^n'' < oo. In addition, by Lemma [Oj if there is A: G N such that E^^^t^) < 
oo but E'('^)(t'^+^) = oo, then for any w G W, E^^\t''w{t)) < oo if and only if 
En=in''win)ai^^ < oo. On another hand, ^(^)(r'=) = ^^^^ , E(R\t''w{t)) = ^^^^"^'"'^"^^ 
and ai^^ = Thus our resuh holds. □ 

Example 5.1. Suppose that a„ = q"'p,n > 0, where ^ < p < 1 and q = 1 — p. Then 
G{t) = and /x = | < 1. So {Xn} is positive recurrent. Similar as Example 14.11 

F{t) = WJEW. Thus R, = 4, F'{R,) = 00 and F{R^) - F{R, - 1) = i;^. So 
by Theorem 12.11 E{R\t°^) < 00 if and only if a < ^. 

We may use Theorem 15.11 and Theorem 15.21 to deduce our result. Immediately, R = 
sup{t : G{t) < 00} = I and G'{R) = 00. Thus the equation G{x) = xG'{x) has unique 
solution, indeed, it is xq = ^. Thus Ri = = 4^- Also under p(^o), {Xn} is the 

same process as in Example 13.11 Therefore for any a > 0, E{R\t°') < 00 if and only if 
a<\. 

Example 5.2. suppose that a > 2 and = (^qrr)" ~ (iT2)°'^ — ^' Then 

11 /■°° 1 1 

\kak = {,,r + {^r + ---< {-Tdx = -<1. 

2 6 Ji X a — 1 



00 

k=0 



Thus {Xn} is a positive recurrent. As A: — )• 00, ~ k~'^^^. So G{t) = 00 for all t > 1 
and R = 1. By Theorem 15. 1|, Ri = 1. For any /3 > 0, YlT=i'^kk^ < 00 if and only if 
(3 < a. So by Theorem 15.31 E{t^) < 00 if and only if /? < a. 
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